A Path-Based Partial Information Decomposition
نویسندگان
چکیده
منابع مشابه
Partial information decomposition as a spatiotemporal filter.
Understanding the mechanisms of distributed computation in cellular automata requires techniques for characterizing the emergent structures that underlie information processing in such systems. Recently, techniques from information theory have been brought to bear on this problem. Building on this work, we utilize the new technique of partial information decomposition to show that previous info...
متن کاملBivariate Partial Information Decomposition: The Optimization Perspective
Bertschinger, Rauh, Olbrich, Jost, and Ay (Entropy, 2014) have proposed a definition of a decomposition of the mutual information MI(X : Y, Z) into shared, synergistic, and unique information by way of solving a convex optimization problem. In this paper, we discuss the solution of their Convex Program from theoretical and practical points of view.
متن کاملThe Partial Information Decomposition of Generative Neural Network Models
In this work we study the distributed representations learnt by generative neural network models. In particular, we investigate the properties of redundant and synergistic information that groups of hidden neurons contain about the target variable. To this end, we use an emerging branch of information theory called partial information decomposition (PID) and track the informational properties o...
متن کاملInformation Flow Based Decomposition of Decision-Making Problems Involving Partial Observability
Industrial planning and scheduling decisions are often inter-dependent. For example, planning level capacity allocation decisions affect production scheduling. While independent decision rules fail to address the above mentioned inter-dependence, simultaneous consideration of all interactions leads to a very large problem, which is oftentimes computationally intractable. In this study, we demon...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Entropy
سال: 2020
ISSN: 1099-4300
DOI: 10.3390/e22090952